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Control-theoretic modeling of human operator’s dynamic behavior in manual control 
tasks has a long, rich history. There has been significant work on techniques used to identify 
the pilot model of a given structure. This research attempts to go beyond pilot identification 
based on experimental data to develop a predictor of pilot behavior. Two methods for pre- 
dicting pilot stick input during changing aircraft dynamics and deducing changes in pilot 
behavior are presented This approach may also have the capability to detect a change in a 
subject due to workload, engagement, etc., or the effects of changes in vehicle dynamics on 
the pilot. With this ability to detect changes in piloting behavior, the possibility now exists to 
mediate human adverse behaviors, hardware failures, and software anomalies with autono- 
my that may ameliorate these undesirable effects. However, appropriate timing of when au- 
tonomy should assume control is dependent on criticality of actions to safety, sensitivity of 
methods to accurately detect these adverse changes, and effects of changes in levels of auto- 
mation of the system as a whole. 
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I. Introduction 

S ignificant research has been conducted to model or identify the pilot, as a way to quantify handling qualities or 
to better understand the behavior of a human pilot in controlling a vehicle 1 ' 7 . The classical McRuer crossover 
model of compensatory manual control states that the human operator will adapt to vehicle dynamics by providing 
lead equalization, with an associated computational penalty, such that the combined operator-vehicle transfer func- 
tion is proportional to an integrator at the crossover frequency 7 . Another approach to understanding the human-as- 
the-controller behavior was the development of the optimal control model by Kleinman, Baron, and Levinson based 
on the assumption that a well-trained and motivated human controller behaves optimally in some sense, adjusting 
the pilot's compensation for a given vehicle and task, subject to human limitations 8 . 

In the last two decades, there has been a renewed interest in modeling the human operator. If the human operator 
can be adequately represented, this will shorten the development cycle, especially in control law development. An- 
other benefit of human operator modeling would be to safely test in various regimes, such as stall and recovery, and 
to investigate accidents. In fact, an accident investigation led Hess to further develop a human operator model 9 . The 
Hess modeling in the frequency domain, a structural model 10 , and Schmidt working in the time domain, a modified 
optimal control pilot model 2, u , attempted to take into consideration appropriate relevant feedback that influenced a 
pilot’s behavior such as proprioceptive cues, and visual and vestibular feedback. While these models proved useful, 
their application to realistic simulation tasks involved a great deal of complexity. In an attempt to simplify the model 
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while still capturing the essential pilot behavioral characteristics, Hess proposed a simplified model that has been 
recently applied to systems with time -varying dynamics 12, 13 . 

In addition, to several relevant model structures to describe the pilot as a controller behavior, there has also been 
significant work on techniques used to identify the pilot model of a given structure 14-20 . These included various ap- 
plications of parameter identification ranging from wavelets -based approach to frequency-based system identifica- 
tion techniques. 

Various models have also been developed using a physiological basis, such as the man-machine integration de- 
sign and analysis system (MIDAS) 21 " 23 . These “human performance modelling process have attempted to integrate 
operator characteristics (cognitive, attentional, and physical) with environmental characteristics to more accurately 
represent human-system operations with new, augmented technologies” 21 . They typically involve higher-level deci- 
sion making models and processes rather than more immediate, direct control actions. 

This research is investigating new analytical methods to model the pilot’s changing behavior over short time pe- 
riods in response to changing aircraft dynamics. This research is attempting to go beyond pilot identification based 
on collected experimental data and to develop a predictor of short-term pilot control behavior in real time. The long 
term goal of this research is to describe a model that goes beyond identifying pilot behavior changes due to vehicle 
dynamic changes but captures changes in pilot’s behavior due to a myriad of factors, such as pilot incapacitation. 
This may enable identification of potential reasons for this behavior change; hence, informing the decision process 
for changing function allocation between pilot and automation. 

Availability of such an analytical model would have impact in a number of different areas. Obviously, it would 
contribute to potential requirements for adaptive control law design helping to ameliorate hardware failures. In more 
pilot-centric arenas, this analytical model may affect the design of decision aids for the pilot by considering the pi- 
lot’s control response or method of piloting the aircraft. It may also help determine the appropriate function alloca- 
tion between the pilot and the automation especially during changes in effective dynamics. The analytical models, if 
similarly applied to autopilots, may also be able to detect software glitches with the automation. Once the system is 
able to detect these failures, appropriate timing of when autonomy should assume control is dependent on criticality 
of actions to safety, sensitivity of methods to accurately detect these adverse changes, and effects of changes in lev- 
els of automation of the system as a whole. 

II. Analytical Model Development 

Data from two separate experiments, briefly described below in Sections IIA and IIB, were used to estimate ve- 
hicle pitch attitude from pilot longitudinal stick input. The estimation methods, described in Section IIC below, were 
a gradient descent estimator and a least squares estimator with exponential forgetting. 

A. Longitudinal Tracking Experiment 

The longitudinal tracking experiment (LTE) was conducted to quantify the effects of changing dynamics on a 
subject’s ability to track a signal in order to eventually model a pilot adapting to changing aircraft dynamics 24 . Each 
run incorporated a different set of second-order aircraft dynamics representing short period transfer function pitch 
attitude response with a potential system time delay: damping ratio, frequency, gain, zero location, and time delay. 
The aircraft short-period attitude transfer function was: 
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where Ois pitch attitude and Sis pilot stick. The damping ratio ( Q was 0.4, 0.7, or 1. The short period frequency ( co ) 
was 0.5 Hz, 1 Hz, or 1.5 Hz. Gain ( K) was 1, 2, or 3. Zero location (LJ was 0.5, 1, or 1.5. Lastly, time delay r was 0 
ms, 75 ms, or 150 ms. For a detailed description of this experiment, see Trujillo and Gregory 24 . 

B. Adaptive Controller Effects on Pilots Experiment 

The adaptive controller effect on pilots experiment (ACE-PE) was conducted to categorize the interactions be- 
tween the pilot and an adaptive controller during change in aircraft dynamics represented by control surface 
failures 25 ' 27 . One of the objectives of this experiment was to determine how the adaptation time of the controller 
affects pilots. This was accomplished by considering whether an adaptive controller helps pilots during control sur- 
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face failures (by measuring tracking error) and how this controller affects pilots before, during, and after the control 
surface failures. The control surface failures were either stuck surfaces or slowly moving surfaces. A human-in-the- 
loop experiment looked at the effects of these control surface failures on pilot performance during cruise phase 
while initiating a climb, descent, or a heading change maneuver. These maneuvers were indicated on the primary 
flight display (PFD) via the flight director and on the engine indication display’s (EID) horizontal and vertical navi- 
gation map displays. Each subject experienced four adaptation times: zero seconds, three seconds, seven seconds, 
and no adaptation (Never). These times indicated how long it took the adaptive controller -aircraft system to settle to 
a new set of dynamics and specific values are based on the response speed of the nominal aircraft dynamics. Zero 
seconds indicated the fastest possible adaptation time, essentially the processor speed. For a detailed description of 
this experiment, see Trujillo and Gregory 25 , Trujillo and Gregory 26 , and Trujillo, et al. 27 ENREF 27 . 

C. Estimation Methods 

In both LTE and ACE-PE , the subjects’ longitudinal stick inputs and longitudinal flight director commands 
were recorded. With this information, a pilot input-output model was built using a gradient descent estimator (GDE) 
and a least squares estimator with exponential forgetting (LSEEF) 28 techniques. The online implementation of the 
GDE is given by 
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where y(t) and x(t) are system output (longitudinal stick) and input signal (pitch command) respectively, ®(jt(t)) is 
the regressor/basis function, T 0 is the estimation gain, 0 is the estimated parameter, and y(t) - 0(t ) rep- 

resents the predicted/estimated output of the model at time t. Note longitudinal stick deflection was normalized to 
± 1 range. Similarly, the online representation of the LSEEF is 
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The variable X(t) is part of exponential forgetting factor which enables LSEEF to track time -varying parameters, 
albeit slowly varying. The rest of the variables are the same as described above for GDE For GDE, the estimation 
gain, T 0 , was recursively calculated for each subject’s run until the estimated longitudinal stick input matched the 
actual longitudinal stick input as close as possible. The estimation gain, T 0 , for LSEEF , was also recursively calcu- 
lated for each subject’s run until the estimated longitudinal stick input matched the actual stick input as close as 
possible. 


III. Results 


The below data analyses were done with IBM SPSS' 
was used for statistical testing. Significance for all tests 
indicate one standard error of the mean (SE). 

A. Estimation Method Accuracy 

The two estimation methods were compared by 
computing the error between the actual longitudinal 
stick input and the estimated longitudinal stick input 
from each of the two methods - GDE and LSEEF - 
using the LTE data (see Section IIA above). 

When comparing the error between the predicted 
longitudinal stick input and the actual longitudinal stick 
input, the GDE method had the least error 
(F 2> 672=157.28; p<0.001) (Table 1). An example com- 


Statistics version 22 29 . An analysis of variance (ANOVA) 
vas set at p<0.05. Lastly, any error bars present in a graph 


Table 1. Estimation Method Accuracy 


Estimation 

Method 

Mean Error + 1 SE 
(Predicted Longitudinal Stick Input - 
Actual Longitudinal Stick Input) 

GDE 

0.046 ± 0.00387 

LSEEF 

0.112 + 0.00384 
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paring the stick inputs of the two methods to the actual pitch output is shown in Figure 1 . 
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Middle Graph: Actual and Predicted Longitudinal Stick Input for GDE and LSEEF 
Bottom Graph: Predicted-Actual Longitudinal Stick Input for GDE and LSEEF 

Furthermore, the GDE adaptation parameter, r 0 , was affected by the subject (F 3 >198 =23.18; p<0.001) (Figure 2), 
short-period damping f (F 1>198 = 5.78; p=0.017) (Figure 3), and was almost statistically dependent on system time 
delay z (F 1>198 =3.\3\ p=0.079) (Figure 3). Hence, for a set of data with constant dynamics for the entirety of a run, 
the adaptation gain is dependent on the subject and on a particular set of dynamics. The same model was then ap- 
plied to a set of dynamics that varied during a run. The GDE method to predict the longitudinal stick input was used 
on another set of data from ACE-PE that involved an adaptive controller responding to surface failures where adap- 
tation time was preset to four specified values before the controller-aircraft system settled on a new set of dynamics. 
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Figure 2. r 0 by Subject 
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B. Detecting Changes in Pilot Longitudinal Output in the ACE -PE Data 

The GDE method was used on the ACE -PE data (see Section IIB above). As with the LTE data, the input data 
was the longitudinal flight director command and the estimated output was the longitudinal stick input. The GDE 
parameter T 0 was calculated for each subject’s runs. 

The GDE parameter T 0 is dependent on who is piloting (7^2773=39.98; p< 0 . 001 ) although there is overlap 
among the six groups (Figure 4 ) defined by the Tukey Honestly Significant Difference post-hoc test. When looking 
at the data, these six overlapping groups appear to consist of three primary groups - subjects with a low T 0 value, 
subjects with a medium T 0 value, and subjects with a high T 0 value (Figure 4 ). This suggests that there may be a 
finite set of methods pilots use to control a vehicle such as continuously minimizing error or waiting until the error 
has grown by a certain amount before quickly attempting to zero out the error. 



Subject 

Figure 4. T 0 by Subject with Groupings 
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Each data run is comprised of three segments: before failure, during failure and after failure. The GDE estima- 
tion parameter T 0 did change dependent on the segment and subject (F 32 , 2773 = 2 . 6 6; p<0.001) (Figure 5). In general, 
T 0 increased during the failure segment and then started to decrease after the failure segment (F 2,2773= 48.72; 
p<0.001) as can be seen in Figure 5 and Figure 6. Eventually, T 0 may return to its value before the failure occurred 
(Figure 6 “Difference in T 0 ”) (F 1>1663 = 80.32; p<0.001) provided post-failure controller-aircraft dynamics return to 
nominal aircraft . Oddly enough, though, the difference in T 0 was not the highest for the case when the adaptive 
controller never adapted (F 3>1759 =66J2; p<0.001) (Figure 7). Further data analysis is required to explain why essen- 
tially instantaneous adaptation indicated pilot behavior change, which has been confirmed by other measures 24 . De- 
spite this anomaly, the results indicate that the amount of time the off-nominal condition is in effect will influence 
the magnitude of T 0 . 
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Figure 7. Difference in T 0 by Adaptation Time 


IV. Discussion and Future Research 

The simplest method, GDE, appears to have suitable accuracy in predicting pilot longitudinal stick inputs. This 
may allow for faster computation of its estimation gain parameter, T 0 , possibly approaching real-time computations. 
The methodology was also able to detect changes in pilot behavior with changing vehicle dynamics during a data 
run. However, this parameter was somewhat dependent on the pilot suggesting that the initial estimation gain may 
need to be calculated for each pilot before flying. This dependency, though, may be categorical based on general 
piloting methods of each pilot. This brings up the additional possibility that if the estimation gain parameter changes 
such that the difference suggests the pilot is now controlling the vehicle using a different method, then this may 
further strengthen the case that there is a problem someplace in the system. In general, the estimation gain parameter 
increased during the failure and then decreased after the failure. If given enough time, this decrease may approach 
the estimation gain to before-failure values. Therefore, this methodology should be able to detect changes in pilot 
behavior possibly in near real time. As part of current and future research, several learning methods are being ap- 
plied to the existing data sets from LTE and ACE-PE to develop multiple models running in parallel to (i) determine 
if a particular learning methodology is better suited to short term pilot behavior predictions and (ii) if multiple meth- 
ods are suitable, then they can be used to minimize false positives and provide better insight into causes of behavior- 
al changes. If this line proves fruitful, then GDE can be used as a first alert since it can give almost real-time indica- 
tion of behavioral changes. Even without potential contribution from learning -based models, the current GDE pre- 
dictor can be used as part of noninvasive suite of measures detecting various stages of pilot incapacitation. 

With other additional information from on-board vehicle state sensors, eye tracking sensors and possibly physio- 
logical measures 30 , it should be possible to determine if detected changes in piloting are due to a vehicle failure or 
issues with the pilot. If it is a piloting issue, such as excessive workload or inattention, less invasive remedial 
measures could be taken depending on the issue. For instance, if workload is high, the automation could direct the 
pilot’s attention back to the aviating task while transferring some of the other tasks to the automation such as auto- 
matic completion of checklists 31 . 

However, if the problem persists, such as a major fault/failure or the pilot is incapacitated, more invasive meth- 
ods to save the aircraft may be needed such as an autonomous landing system which recognizes suitable airfields, 
calculates a safe trajectory to a particular airfield, notifies air traffic control while flying the new safe trajectory, and 
finally lands the aircraft. Determining when the automation should take over needs to be carefully considered. Obvi- 
ously, if the pilot is incapacitated, determined via additional physiological measures and lack of response, then the 
automation taking over is justified. However, if the pilot is not fully incapacitated, then transferring control to auto- 
mation becomes a more complex question. While the pilot may not be fully incapacitated her ability to competently 
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fly may be highly impaired; however, several sources of corroborating evidence would be required. One such piece 
of evidence could be a large abrupt change in the estimation gain parameter or continuous change (outside a preset 
deadzone) in this parameter suggesting that the pilot is trying to adapt to a discrete event or degrading conditions. 
This information, in addition to physiological measures and changes in aircraft state information, may provide the 
evidence requiring the automation to take control of the aircraft from the pilot and conversely if it is appropriate to 
release control back to the pilot 32-34 . 

Lastly, the analytical method described above, if similarly applied to autopilots, may also be able to detect soft- 
ware anomalies with the automation. The method applied would be similar as the one described for pilots - a sudden 
change or continuous changes in the estimation gain parameter but with no detected aircraft state anomalies. In this 
case, though, the automation might determine that it is best to hand full control to the pilot. 

Therefore, developing an analytical model of the pilot that can be computed in near real time opens up the possi- 
bility of detecting and quantifying changes in piloting behavior. Combining this information with physiological data 
and aircraft state could further refine the function allocation between the pilot and the automation and could increase 
the possibility of safely determining when the autonomy should fully take over from an incapacitated pilot. 
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